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Abstract 

Let T be a coherent rank 2 sheaf on a scheme Y C P™ of dimension at least two. In this paper 
we study the relationship between the functor which deforms a pair {J-, a), a £ H° {J 7 ) , and 
the functor which deforms the corresponding pair (X, £) given as in the Serre correspondence. 
We prove that the scheme structure of e.g. the moduli scheme My(P) of stable sheaves on 
a threefold Y at (J 7 ), and the scheme structure at (X) of the Hilbert scheme of curves on Y 
are closely related. Using this relationship we get criteria for the dimension and smoothness 
of My(P) at without assuming Ext 2 (J r , J 7 ) — 0. For reflexive sheaves on Y = P 3 whose 
deficiency module M = Hl(J-) satisfies oExt 2 (M,M) — (e.g. of diameter at most 2), we get 
necessary and sufficient conditions of unobstructedness which coincide in the diameter one case. 
The conditions are further equivalent to the vanishing of certain graded Betti numbers of the 
free graded minimal resolution of H®{T). It follows that every irreducible component of M P 3(P) 
containing a reflexive sheaf of diameter one is reduced (generically smooth) . We also determine 
a good lower bound for the dimension of any component of M P 3 (P) which contains a reflexive 
stable sheaf with "small" deficiency module M. 

AMS Subject Classification. 14C05, 14D22, 14F05, 14J10, 14H50, 14B10, 13D02, 13D07. 
Keywords. Moduli space, reflexive sheaf, Hilbert scheme, space curve, Buchsbaum sheaf, un- 
obstructedness, cup product, graded Betti numbers. 

1 Introduction and Main Results 

Let Y C P n be an equidimensional, locally Cohen-Macaulay (CM), closed subscheme of dimension 
at least two and let T be a coherent rank 2 sheaf on Y . Let Hilbx/y be the local Hilbert functor 
of flat deformations X$ C Y x S, S a local artinian /c-algebra, of a codimension 2 subscheme X 
of Y. An effective method of studying the Hilbert scheme, Hilb p (Y~), of subschemes of Y with 
Hilbert polynomial p with respect to smoothness, dimension and irreducibility at (X), is to look at 
other local deformation functors D over Hilbwy, D — » Hilbwy, which allow a surjective tangent 
map £d - ► *Hiib x/y = H°(Mx/y), Nx/y = {^x/Y I^x/y)* ^ an d a corresponding injective map of 
obstruction spaces. We consider such deformation functors D which determine Hilb p (Y) locally 
under various assumptions. In particular we look to the functor of deformations of a pair (J 7 , a), or 
equivalently of the pair (X, £) where £ is an extension as in the Serre correspondence 

£ ; 0^O Y ^F^1 x /y®£^0 ■ (1) 

see [E], [17], [44], [45] and [46] for the existence of such extensions. Let Defjr (resp. Defjr )Cr ) be the 
local deformation functor of flat deformations Ts of T (resp. OyxS of Oy J 7 ). Note 

that we have an obvious forgetful map p : DefjF )(7 — ► Defjr- There exists also a natural projection 
Defjr )(T -» Hilbx/y given by 

(OyxS ^ Fs) -> ((coker a s ) ®o YxS {OyxS ®o y C 1 )) 

which one may think of as given by the (relative) Serre correspondence and the forgetful map 
(Xs,Cs) — > {Xs)- We shortly write coker as ® C~ x for (coker as) <8>o yxS (OyxS ®Oy ^C" 1 ). Using 
small letters for the dimensions, e.g. ext^-F, T) = dim Ext* (JF, J 7 ) and hP{T) = dimH ^) we prove 



Theorem 1. With the notations above, suppose Y is locally CM and equidimensional of dimension 
dimY" > 2 and such that H°(Oy) — k and H 1 (Oy) = for i = 1 and 2. Moreover we suppose 
there exists an exact sequence where X is equidimensional and locally CM of codimension 2 
in Y and Zx/Y = ker(0y — > Ox)- Then Ext 1 (Tx/y ® A-? 7 ) * s ^ e tangent space of DefV jCr ane? 
Ext 2 (2x/y <£)C,?) contains the obstructions of deforming (?,a). Moreover 

(i) p : Defjr i(J — > Defjr is smooth (i.e. formally smooth) provided H 1 (?) = 0, and 
(m) g : Defter - > Hilbxyy «s smooth provided Ext^ y (J 7 , 0y) = 0. 
Furthermore suppose H 1 (?) = 0, Ext 2 0y (?, Oy) = 0, and toat u>y is invertible. Then 
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ext^?,?) - hom(?,?) + h°(?) = h (Af x / Y ) ~ 1 + h°(u x <8> Wy 1 ® £ _1 ) - J^OC -1 ). 

i=0 

Suppose in addition that ? is stable (GM-stable) and H l (C~ l ) = for i = 0, 1, 2. T/ien 

dim { ^) My(-P) + h°(?) = dim (x) Hilb p (Y") + h°(u x ® w^ 1 ® ZT 1 ) , and 

My(-P), i/ie moduli scheme of stable sheaves with Hilbert polynomial P on Y, is smooth at (?) if 
and only «/Hilb p (Y") is smooth at (X). Moreover J- is a generic sheaf of some component o/My(P) 
if and only if X is generic in a corresponding component o/Hilb p (Y~). 

Let F = H°(?) := ®H Q (?(v)), M = Hl(?) and E = H%(?). If Hom(F,M) = and Y is 
arithmetically Cohen-Macaulay (ACM), then we show that the local graded deformation functors of 
F and of (F,H®(a)) are isomorphic to Defjr and DefjF )(7 respectively. We get the following variation 
of Theorem QJi); that p is smooth provided oHom(F, M) = and Y is ACM. 

One may interpret the morphisms p and q in Theorem Q] as corresponding to natural projections 
in an incidence correspondence of schemes of corepresentable functors, connecting My(P) closely to 
Hilb p (y). Under the assumptions of Theorem[T]the projections are smooth of known fiber dimension. 
Since the fiber dimensions are easy to see and the Serre correspondence is well understood (|15j), 
related arguments as in the theorem are used in the literature, especially to compute dimensions of 
or describe very specific moduli schemes (e.g. [4], [14], [16], [IB], [34], [42], [8] and see [45], sect. 4 
for results and a discussion). It is, however, under the mere assumptions of (i) and (ii) above we are 
able to precisely see that the scheme structures of My(-P) and Hilb p (Y~) are "the same". To apply 
Theorem Q] we neither need H 1 (Nx/y) = 0, nor Ext^ (?, ?) = to prove the smoothness of the 
moduli schemes. This, we think, significantly distinguishes our theorem from the results and the 
proofs of the mentioned papers. For the complete picture we have no better reference that an old 
preprint of the author ([E], for the case Y = P 3 ) and the paper [9j which explicitly makes use of 
(without proofs) and slightly extends the results of |19| . and we therefore include full proofs. 

As an application we prove several results concerning smoothness and dimension of the moduli 
space, M P 3(ci, c?, C3), of stable reflexive sheaves of rank 2 with Chern classes c\, c 2 and C3 on P 3 . In 
some cases, especially for C3 = or small c 2 or large C3, one knows the answer, e.g. see [1], [3], [4], 
[S], [9], [H], p], p], [33], [34] and [30]. Much is still unknown about M p3 (ci, c 2 , c 3 ), see [40] for an 
overview of recent research. Let 

ed(?) = ext^?,?) - ext 2 0y (?,?) 

(using small letters for the dimension of the global Ext-group). If ? is stable, then ed(^ r ) is sometimes 
called the "expected dimension" of My(P) at (?) and ed(;F) = 8c 2 -2cf-3 if Y = P 3 . We prove that 
Mp3(ci,C2, C3) is smooth at (?), i.e. that ? is unobstructed, and we find dim^ Mpa(ci, c 2 , C3) pro- 
vided we have sufficient vanishing of v Homji(F, M) and „Hom^(M, E) for v = and —4 (Theorem[9j). 



2 



This result generalizes [33], which gives the complete answer for M = 0. Let Ext 2 R (M,M) = 0. 
Using that the composition 

V : Rom R (F,M) x Rom R (M,E) — » Hom R (F, £) , (2) 

commutes with the cup product, we show that T is obstructed if t] ^ (cf. [10], [23], [II]). Thanks 
to this result we get that the sufficient conditions of unobstructedness of Theorem [9] are close (resp. 
equivalent) to being necessary conditions provided the diameter of M is small (resp. one). Since we 
can substitute the non- vanishing of the Horn-groups of Theorem [9] by the non-triviality of certain 
graded Betti numbers appearing in the minimal resolution, 

o -> o F (-if^ - Op - F (-i)^ - .F - , 

i i i 

of J 7 and we explicitly compute ohom^(F, E) (see Remark l20l) . we get 

Theorem 2. Zei T be reflexive of rank 2 on P 3 and suppose M ^ is r -dimensional of diameter 1 
and concentrated in degree c. Then T is obstructed if and only if 

Pi,c ■ (32,0+4 7^0 or /3i jC+4 • /?2,c+4 ^ or /3i )C • (3 2)C • 

Moreover if J- is an unobstructed stable sheaf, then the dimension of the moduli scheme Mp3(ci, 02,03) 
at (J 7 ) is 

dim (J r) M p3 (ci,C2,c 3 ) = ed(.F) + hom R (F, E) + r(^i jC+4 + /3 2 , c ). 

It follows that every irreducible component of Mp3(ci, 02, C3) whose generic sheaf J 7 satisfies 
diamM = 1 is reduced (i.e. generically smooth). If diamM = m we give examples of moduli spaces 
Mp3(ci,C2, C3) containing a non-reduced component for every integer m > 3. If diamM = 2 we 
conjecture that the corresponding component of M P 3(ci, C2, C3) is generically smooth. We also give 
a new formula for the dimension of any generically smooth irreducible component of Mps(ci, 02,03) 
(Theorem 1221) . Even though some of the results of this paper may have a direct proof in which 
the condition "reflexive" is replaced by "torsionfree", we have chosen just to use Theorem [T] and the 
corresponding results for Hilb p (P 3 ). 

The main results of this paper were lectured at the workshop on "Vector Bundles and Low 
Codimensional Subvarieties" at Trento, in September 2006. The author thanks the organizers 
for their hospitality. Theorem [T] for Y = P 3 , Example [6] and Example [7] were the main re- 
sults (except for the dimension statements) in an old preprint of the author (|19J, available at 
http://www.iu.hio.no/~jank/papers.htm). Moreover I heartily thank prof. O. A. Laudal at Oslo, 
prof. S.A. Str0mme at Bergen and prof. R.M. Miro-Roig at Barcelona for interesting discussions 
and comments. 

1.1 Notations and terminology 

R = k[Xo,Xi, ...,X n ] is a graded polynomial ring over an algebraically closed k of arbitrary char- 
acteristic with the standard grading, m = (Xq, .., X n ) and Y C P™ is a closed equidimensional, 
locally Cohen-Macaulay (CM) subscheme. We keep the other notations of the introduction. A 
curve X in P n (resp. in Y) is an equidimensional, locally CM subscheme of P := P n (resp. of 
Y) of dimension one with sheaf ideal Ix (resp. 1 x /y) an d normal sheaf Mx = 7~Lonio v (T x ,O x ) 
(resp. M x /y = Homoy(Iwy,Ox) m Y). X is unobstructed if the Hilbert scheme is smooth at 
the corresponding point (X) = {X C P n ), otherwise X is obstructed. The Hilbert scheme of space 
curves of degree d and arithmetic genus g is denoted by H(d, g). If J 7 is a coherent Oy-Module, 
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we let WiF) = iI*(Y, T) and ti(T) = dim 12* (.F), and we denote by x(f) = ^(-ifh^J 7 ). Then 
Ix '■= H®(F,Xx) is the saturated homogeneous ideal of Z in P". 

Let M = M("F) be the deficiency module Hl{F). T is said to be unobstructed if the hull 
of the local deformation functor, Defjr, is smooth. By stable we mean GM-stable, i.e. stable 
in the sense of Gieseker and Maruyama in which the Hilbert polynomial (and not the I s * Chern 
class) is used to define stability (see [17J, ch. I). Thus a stable T is unobstructed iff My(P), the 
moduli scheme of stable sheaves with Hilbert polynomial P on Y, is smooth at (J 7 ) ([32], Thm. 
4.5.1). The two concepts of stability are the same if Y = P 3 ([15J, Rem. 3.1.1). Stable sheaves are 
simple, i.e. Hom(jF, J 7 ) ~ k ([17], Cor. 1.2.8). A coherent sheaf J 7 is reflexive iff T ~ J 7 ** where 
J 7 * = TiomiF,—) (see [E]). In the case Y is a smooth threefold, we denote by My (01,02,03) the 
moduli scheme of stable reflexive sheaves of rank 2 on Y with Chern classes 01,02 and C3. Thus 
My(ci, 02,03) is open in My(P). For any T of My(ci, C2, C3) there exists an exact sequence after 
replacing T by some F{t), due to a theorem of Hartshorne. In fact defines a correspondence 
between the sets of pairs ( J 7 , s) and pairs (X, £) provided £ generates ® Wy 1 <8> except at 
finitely many points (the Hartshorne-Serre correspondence, see [15], Thm. 4.1 and [44], Thm. 1). 

A sheaf J 7 of rank 2 on P 3 is said to be Buchsbaum if m ■ M{T) = 0. We define the di- 
ameter of M(JF) (or of J 7 ) by diamM(.F) = c — b + 1 where & = min{n|/i 1 (^ r (n)) 7^ 0} and 
c = max{n|/i 1 (^ r (n)) 7^ 0} and by diamM(J r ) = if M(JF) = 0. The diameter of a curve C, 
diam M(C), is correspondingly defined. A curve in a sufficiently small open irreducible subset of 
H(d, g) (small enough to satisfy all the openness properties which we want to pose) is called a generic 
curve of H(d, g), and accordingly, if we state that a generic curve has a certain property, then there 
is a non-empty open irreducible subset of H(d, g) of curves having this property. A generization 
C C P 3 of C C P 3 in H(cZ, g) is a the generic curve of some irreducible subset of H(d, g) containing 
(C). In the same way we use the word generic and generization for a stable sheaf. By an irreducible 
component of H(<i, g) or M F 3 (01,02,03) we always mean a non-embedded irreducible component. 

For any graded R-module N we have the right derived functors H % m (N) and t; Ext^ n (A r , — ) of 
T m (N) = J2v kei ( N v -» F(P,iV»)) and T m (Hom R (N, -))„ respectively (cf. pj], exp. VI). We 
use small letters for the /c-dimension and subscript v for the homogeneous part of degree v, e.g. 
v ex.t l m (Ni, N 2 ) = dim„ExtJ n (A"i, N 2 ), for graded iJ-modules N{ of finite type. There is a spectral 
sequence ([H], exp. VI) 

= v -Ete? R (N 1} Hl(N 2 )) => v Ext^(N u N 2 ) (3) 

(=>■ means "converging to") and a duality isomorphism ([22], Thm. 1.1); 

„Extj+ 1 (^2,iV 1 ) ~ _ v Ext^~* (JV"i , N 2 (—n - l)) v (4) 

where (-) v = Hom fc (-, k), generalizing the Gorenstein duality W H^ 1 (M) ~ _„Ext^" i (M, i?(-4)) v . 
These groups fit into a long exact sequence ([H], exp. VI) 

- „Ex4(Aq, JV 2 ) -» „Exti(7Vi, JV 2 ) - Extbp(JVi, N 2 (v)) - ^Ext^ 1 ^, W 2 ) -» (5) 

which e.g. relates the deformation theory of A C P 3 , described by H (Mx) — Ex.t l Q r (Tx,Xx) for 
i = l,2, to the deformation theory of the homogeneous ideal I = Ix (or equivalently of A = R/I), 
described by oExt R (Ix, Ix), in the following exact sequence 

v Ext)t(I, I) — H°(M c (v)) -> ,Ext^(/,/) ^ExtK/,7) -> H\M C {v)) -> .Extf^/,/) -> (6) 

(cf. [23], section 2). Let M(A) = H^(I). Note that, in this situation, C. Walter proved in 
[48], Thm. 2.3 that the map a : „Ext^(J,I) ~ v Rom R (I,Hl(I)) -> „Ext|(I,J) of © factorizes 
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via v Ex.t 2 R (M (X) , M (X)) in a natural way, the factorization is in fact given by a certain edge 
homomorphism of the spectral sequence J3|) with Ni = M, N2 = I and p + q = 4 (cf. [10], Thm 
2.5). We frequently refer to [23] and all results we use from [23] are true without the characteristic 
zero assumption of the field quoted for that paper. 

2 The scheme structure in the Serre correspondence 

In this section we will prove the basic Theorem Q] and its variations. Moreover we give some appli- 
cations and examples of moduli schemes My (ci, 02,03) in the case Y = P 3 . In particular we show 
that some Mp3 (01,02,03) contains a non-reduced component. 

The local deformation functors Def^, Def^ j(J and Hilbx/y of the Introduction were defined on 
the category I whose objects are local artinian /c-algebras S with residue field k and whose morphisms 
are homomorphisms of local rings over k. Associated to {1]) there is also another local deformation 
functor on U 

Bef x/Y4 (S) = {{X s C Y s ,ts) I (X s C Y s ) G Hilb x/y (S) and £ s ®s k = £} 

where Ys := Y x S (we shortly write Y x S for Y x Spec(5)), Cs := Oy s ®o Y £ and £s € 
Ext 1 (Xx s /y s ® Cs,Oy s )- Now Theorem Q] follows easily from the following basic result about the 
relationship of dimensions and the scheme structures in the Serre correspondence. 

Theorem 3. Let Y C P" be locally CM and equidimensional of dimension dimY > 2 such that 
H°(Oy) k and W(O y ) = for i = 1,2. Moreover suppose there exists an exact sequence (TJ) 
where X is equidimensional and locally CM of codimension 2 in Y and T x / Y = ker(0y — > Ox). 
Then 

(a) Ext 1 (Tx/y <S> A J 7 ) is i/ie tangent space of Defjr.o- a^rf Ext 2 (Xx/y ® contains the ob- 
structions of deforming (J 7 , a). Moreover Def^- j(J ~ Def^/y^ are isomorphic on I and 

(i) p : DefjFo- — > Defjr is smooth (i.e. formally smooth) provided H 1 ^) = 0, and 
(n) q : Defjp.o- — > Hilb^/y is smooth provided Ext 2 ^ (J 7 , Oy) = 0. 

(b) Suppose H 1 ^) = 0, Ext^ Y (^,Oy) = 0, and that ujy is invertible. Then 

2 

ext 1 ^,^) - hom(T,T) + h°{T) = h°(M x/Y ) ~ 1 + h (u x <8> Wy 1 g> - ^(-l)W(Zr 1 ). 

i=0 

Suppose in addition that T is stable and H l (£~ l ) = for i = 0, 1, 2. Then 

dim (r) M Y (P) + «°(^) = dim (X ) Hilb p (Y) + ® w^ 1 /T 1 ). 

It follows that My (P) is smooth at (J 7 ) if and only ifHilb p (Y) is smooth at (X). Furthermore J 7 is a 
generic sheaf of some component ofMy(P) if and only if X is generic in a corresponding component 
o/Hilb p (y). 

Remark 4. Under the assumptions of Theorem [3| (a), we get that H 1 ^) ~ H x {l x/Y <g> C) and 
Ext^, y ( T, Oy ) — Ext 2 (Xx/y <S> C, Oy) by using §J§. Moreover, if the dualizing sheaf lu y is invertible 
(i.e. Y locally Gorenstein), then 

Ext^(^, Oy) y ~ H dimY -\T toy) and Ext 2 (l x/Y <g> £, Oy) v ~ F dimy - 2 (J x/ y ® £ <g> w y ). 
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In the case Y is locally Gorenstein and the immersion Y P n induces an isomorphism Z = 
Pic(P n ) ~ Pic(Y), we will use this isomorphism to look upon the first Chern class c\ as an integer, 
i.e. C ~ A 2 J- = Oy(ci). Moreover put wy = 0y(e). By Remark |4] Theorem [3] immediately implies 

Theorem 5. Suppose Y C P n is locally Gorenstein and equidimensional of dimension dimY > 2 
such that H (Oy) — k, H 1 (Oy) = for i = l,2 and Pic(P n ) ~ Pic(y). Moreover we suppose there 
is an exact sequence of 0y -Modules 

C ; 0^O Y -^T^ 1 x /y(ci) ^0 (7) 

where X is equidimensional and locally CM of codimension 2 in Y and Iwy = ker(Oy — ► Ox)- 
Then Ext 1 (Xx/y(ci), J-) is the tangent space. o/DefjF j(7 and Ext 2 (Xx/y (ci), .F) contains the obstruc- 
tions of deforming (J 7 , a) . Moreover 

(i) p : DefjFo- — > Defy is smooth provided H (X x /y ( c i)) = > onc ^ 

(m) g : Defjr j(J — > Hilb^/y «s smooth provided H dimY ~ 2 (T x /Y( c i + e)) = . 

Furthermore if ^(Cy(-ci)) = for i = 0,1,2, H 1 {T x /y{ci)) = 0, H dimY - 2 (l x/Y (ci + e)) = 

and J 7 is a stable sheaf, then 

ext 1 ^,^) + = h°(Af x/Y ) + h°(u x (-ci - e)) , and 

dim ( ^ M Y (P) + /i°(^) = dim (x) Hilb p (Y) + /i°(w x (-ci - e)). 

Finally J 7 is a generic sheaf of some component of My(-P) «/ and on/?/ «/ X is generic in a corre- 
sponding component o/Hilb p (Y). 

Somehow we may look upon the theorem as the Hartshorne-Serre correspondence for flat families. 
We don't, however, need T to be reflexive (only torsionfree as one may easily deduce from (Q). 

We shortly return to the proof of Theorem [3] Firstly we give an example to see that conditions 
as in Theorem [5] are necessary for comparing the structure of H(d, g) and Mpa (01,02,03), while the 
same example "twisted" leads to a non-reduced component of M P 3 (01,02, 03) once the conditions of 
the theorem are satisfied. Below we will need the following result (|21J, Prop. 3.2). Let C and X be 
two space curves which are algebraically linked by a complete intersection of two surfaces of degrees 
/ and g (a ci. of type (/, g)), see [3XJ for the theory on linkage. If we suppose 

H\l c (v))=Q iovv = f,g,f -4 and g -4, (8) 

then C is unobstructed (resp. generic) iff X is unobstructed (resp. generic), and we have 

dim (c) H(d,g) + h°(l c (f)) + h°(lc(g)) = dim (x) H(d', g) + h°(l x (f)) + h°(l x (g)). 

Example 6. The generic curve C of Mumford's well-known example of a non-reduced component 
o/H(14,24) satisfies H l (l c (v)) = for v ^ 3,4,5 ffiffi. Moreover there is a ci. of type (6,6) 
containing C whose linked curve is smooth. Hence by the result mentioned in (JSj) the linked curve 
is the general curve X of a non-reduced component o/H(22,56) of dimension 88. We leave to the 
reader to verify that X is subcanonical (u>x — Ox(5) ) and satisfies H 1 (Ix{ v )) = for u ^ 3,4, 5. 

(a) If we take a general element of H°(Ox) — H°(ivx(—5)) ~ Ext 1 (Zx, Ops (—9)), we get an 
extension 

e ; 0^O p3 ^£^ Jj<-(9) -0 (9) 

in which £ is a stable vector bundle with c\ = 9 and c\[£ (— 5)) = — 1, C2(£ (— 5)) = 2. It is well 
known that~M.-pz{—l, 2, 0) is smooth Jiffl . i.e. £ is unobstructed while X is obstructed. The assumption 
H l (lx{c\+e)) = of Theorem^ is, however, not satisfied. Indeed H l (Zx{ci+e)) = H 1 {Xx{^>)) 7^ 0. 
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(b) If we take a general global section of Ox (3) — ^x(— 2) we get an extension 

£ ; 0^O P 3 ^T^T X {$) ^0 (10) 

in which J 7 is a stable reflexive sheaf belonging to M P 3(6, 22,66) ~ M P 3(0, 13,66). Since all assump- 
tions of Theorem^ are satisfied, we conclude that T is the general point of a non-reduced component 
of M p3 (0, 13,66) of dimension -h°(F) + dim {X ) H(22,56) + h°(u x (-2)) = -8 + 88 + 21 = 101. 
Note that we in this case have ed(J-) = 8C2 — 2c\ — 3 = 101, i.e. the component is non-reduced of 
the least possible dimension. 

Example 7. Here we apply Theorem^ directly to Mumford's example of a generic obstructed curve 
CeH(14,24). 

(a) If we take a general element of H°(u c (2)) ~ Ext 1 (2c, Ops(-2)), we get an extension 

£ ; 0^O p3 ^T^T C {2) -► (11) 

in which J- is a stable reflexive sheaf with c\ = 2 and c\{J-{ — 1)) = 0, C2{J 7 {— 1)) = 13. The 
assumptions H l (lc{ci)) = 0, ff 1 (2c(ci— 4)) = of Theorem^ are satisfied and we get a non-reduced 
component o/M p3 (0, 13, 74) of dimension -h°(F) + dim (C ) H(14, 24) +h°(u c (2)) = -1 + 56 + 51 = 
106. 

(b) If we take a general global section of H°(u)c(3)) — Ext 1 (2c, P 3 (— 1)) we get by Theorem^ 
(with c\ = 1) an extension where J 7 is a stable reflexive sheaf belonging to a non-reduced component 
o/M p3 (l, 14,88) ~ Mps(-1, 14,88) of dimension -1 + 56 + 65 = 120. 

(c) If we take a general global section of H°(u>c(— 2)) — Ext 1 (2c, p3 (— 6)) we get by Theorem^ 
(with c\ = 6) an extension where T is a semistable obstructed reflexive sheaf belonging to the moduli 
space of semistable sheaves M P 3(6, 14, 18) ~ M P 3(0, 5, 18). Even though T is obstructed, i.e. the hull 
of the local deformation functor is singular, we don't yet know the hulls precise relationship to the 
local ring Ojg ,-p\ of M P 3(0, 5, 18) at (J 7 ) and we are not able to state whether Ojj is singular or 
not. 

Proof (of Theorem EJ). (a) Using Laudal's results ([24]) for the local deformation functor of deforming 
a category, we claim that Ext (2v/y (g> C,T) is the tangent space of Defjr, CT and that Ext 2 (2x/y <8> 
C,T) contains the obstructions of deforming (J 7 , a). Indeed by [25], §2 there is a spectral sequence 

f Ext 9 (^,^) Ext 9 (0y,0y) ) 
£f' 9 = lim^ \ a " / \ 

[ Ext«(0y,^) J 

converging to an algebra cohomology group A^> for which A 1 is the tangent space of Def CT and A 2 
contains the obstructions of deforming (J 7 , a). Since E^ q = for p > 2, we get the exact sequence 

-> El*- 1 -» A q -> E°' q -» . 

Moreover Ext q (Oy , O y ) = for < q < 3 by the assumption IP (Or) = for i = 1,2, and 
we get E^ q = kera 9 and E^ q = cokera 9 for q > 0. Observe also that E^' = cokera because 
k ~ H (O Y ) ^ Hom(Oy,Oy) C Hom(f,f). We therefore have an exact sequence 

-> coker a q ~ x -»• A q -»• ker a q -» 

for any q > 0. Combining with the long exact sequence 

-» Hom(f, J 7 ) fl°(^) -» Ext^T^/y ® £, .F) Ext 1 ^, F) (12) 
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H\T) -» Ext 2 (J x/y ® Ext 2 (^,.T) F 2 (.F) 

deduced from — > 0y — > J 7 — > Iwy (8 £ — > , we get the claim. 

(i) From lfT2l) and the proven claim which leads to the fact that p 1 (resp. p 2 ) is the tangent 
map (resp. a map of obstruction spaces, mapping obstructions to obstructions) of p, we get the 
smoothness of p since p 1 is surjective and p 2 is injective. We will, however, give an independent 
proof which one may use (slightly changed) to prove the remark below. 

Let (T, mr) — > (S,ms) be a small Artinian surjection (i.e. of local Artinian fc-algebras with 
residue fields k whose kernel a satisfies o • my = 0). To prove the (formal) smoothness of p, we must 
by definition show that the map 

Def^T) -» Bei T>a (S) x Def^(T) 

is surjective. Let as '■ OyxS Ts be a deformation of a to 5 and let Tt be a deformation of Ts 
to T . It suffices to find a map ot '■ OyxT — ► Tt such that ot ®t ids = &S> i- e - we must prove that 
H°(Tt) — * H°(Ts) is surjective. Taking global sections of the short exact sequence 

— > T %h a — Tt ®t a — ► Tt —*■ Ts —> , 

we get the surjectivity because H 1 ^) <g)£ o = 0. 

(ii) Again we have a long exact sequence 

^ Ext 1 (1 X/Y ® C,<D Y ) ^ Ext 1 {1 X/Y ® £,F) -fUEx^px/Y ®£,Ix/y ®£) -» (13) 

Ext 2 (J x/y <g> £, Oy) -► Ext 2 (I x/y ®£,T)^ Ext 2 (I x/Y <S> A^x/y ® £) -> 

containing maps c/ 1 (resp. q 2 ) which we may interpret as the tangent map (resp. a map of obstruction 
spaces, which maps obstructions to obstructions) of q. Indeed since Sx^^x/y^x/y) — ^XIY an d 
TLom(Zx/Y )3-x/y) — Oy, the assumption H 1 (Oy) = for i = 1, 2 and the spectral sequence 
relating global and local Ext-groups show Ext (^x/Y^X/y) — H°(M x /y) and the injectivity of 
Ext 2 (Xx/y ,2x/y) ^ ^(Nx/y) ( see |43j . the case Y = P 3 was in fact proved in [E]), as well as 

Ext\T x /Y ® £,^x/y ® £) ^ Extfe/y^/y) (14) 

for i = 1,2. Hence we get the smoothness of g because q 1 is surjective and g 2 is injective by the 
assumption Ext 2 (Xx/y ® £, Cy) — Ext 2 (J r , 0y) = 0. We will, however, again give an independent 
proof using the definition of smoothness. 

Let T — ► S, a and as ■ OyxS —* Ts be as in the proof of (i) above. Let Gs = coker as and let Gt 
be a deformation of Gs to T. By the theory of extensions it suffices to show that the natural map 

Ext 1 ^, Oyxt) -» Ext\Gs,0 Y xs) 

is surjective. Modulo isomorphisms we refind this map in the middle of the long exact sequence 

-> Ext x (g T , Oy xT <g) T a) -> Ext^ar, CVxt) -» Ext 1 ^, Oy xS ) -» Ext 2 (£ T , Oy xT ® T a) (15) 

Since Ext 2 (<yTj OyxT ®T a) ~ Ext 2 (Xx/y ® £, Oy) <8>fc a = by assumption we get the smoothness. 

To see that Def^ iCr (5) ~ Defx/y^S) are isomorphic, take a deformation Oy X 5 — ^* •T'S of 
Oy — — > J-". Since ^5 is flat, so are coker erg and (coker 0-5) (80^ (Cy g ®o Y £ -1 )- The former 
fits into a short exact sequence starting with — > OyxS — ^> J^s, i.e. we get an extension £5 
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satisfying £s ®s k = £. The latter is a flat deformation of Xx/y. Thanks to the isomorphism 
Ext (Xx/y, Xx/y) ~ H°(Nx/y) and the injectivity Ext 2 (Xx/y,Xx/y) ^ H l {N x / Y ) above, one 
knows that a deformation of T x /y defines a deformation of X in Y, i.e. we get an element (J¥g C 
Ys) G Hilb x / Y {S) and hence we get (X5 C 5^s,^s) S Def x /y^(S). This defines a map Def^ <a (S) — > 
Defx/y,^*?). Since the morphism the other way is just an obvious forgetful map, we get a functorial 
isomorphism DefjF j(7 (S) ~ Defx/y^S*), as claimed in the Theorem. 

(b) To prove the first dimension formula, we continue (PT2j) to the left. Using H 1 ^) = we get 



exf(Xx/y ®C,J=) = ext^X", X) - J") + /i°(X) 

i=0 

while (US) (continued), Ext 2 (X, Oy) = 0, Hom(l x/Y ,2 x /y) - Oy and JUJ) show 

1 1 
^(-l) m extfe/y ® £, X") = vti\l x/Y ,I xfY ) - 1 + ]T(-iy +1 ext^Xx/y ® A Oy)- 



i=0 i=0 

Since fxi 1 (Xx/y, Xx/y) — ■N'x/Y it remains to show J2l=o(~ ex t l (^X/V ® A Oy) = h°(uj x <g> 
^ y 1 ^£- 1 )-ELo(- 1 )* /l4 ( £ ^ 1 )- Since Hom(l x/Y <S> £, Oy) ^ £ _1 , Sxt^Ix/y, Oy) ^ wi ® Wy 1 
and Ext 2 (Xx/y ® £, Oy) = (Remark[4|, we get hom(Xx/y ® C, O y ) = /i ^" 1 ) and 

ext^Xx/y (8 £, Oy) = h°(uj x ® w y x ® ZT 1 ) + ^(/T 1 ) - ^(ZT 1 ) 

by the spectral sequence relating global and local Ext-groups, and we get the first dimension formula. 

Finally to see the last dimension formula and the genericness property, let U C Hilb p (Y~) be a 
small enough open smooth connected subscheme containing (X) and let Z Xu /y u be the sheaf ideal 
of Xjj C Yy := Y x U, the universal object of Hilb p (Y) restricted to U. Let Ly := C ®o Y @YxU- 
Looking to (fl~3l) which takes the form 



0^ H (O Y ) -^Ext^Xx/y ® £,Oy) -» Ext 1 (Xx/y (8) C, X") Ext 1 (Xx/y, Xx/y) -» (16) 

and recalling that q 1 is the tangent map of q : Def jf,o- — ► Hilbx/y and that g is smooth, we can look 
upon the fiber of q as Ext 1 (Xx/y <8>£, Oy)jk. In the same way since X" is stable and hence simple we 
can use the exact sequence (fT2|) to see that the fiber of p is isomorphic to H (X")/&. Hence we get the 
second dimension formula since the functor Def is prorepresented by the completion of the local ring 
of My(-P) at (X") ([13, Thm. 4.5.1). More precisely the family D := P(Ext 1 (Xx u /y E/ <S>C V , Yu ) v ) -> 
U parametrizes exactly extensions as in ([TJ) over U and the definition of a moduli space implies the 
existence of a morphism p : D — > My(-P) whose corresponding local homomorphism at (X, a) and 
(X) induces p. Note that p is smooth &t(X C Y,£) and hence maps the generic point of D onto a 
generic point of My(X). This also proves that X is a generic sheaf of some component of My(P) if 
and only if X is generic in a corresponding component of Hilb p (Y~) and we get all conclusions of in 
the Theorem. □ 

Remark 8. (a) Suppose Y is ACM and let B := H~(O y ). Applying H®(— ) onto ([TJ) we get an 

exact sequence 

O^B H -^ } F -» coker(H°(o-)) -» 

inducing a long exact sequence (*) as in (PT2l) in which we have replaced the global Ext-groups of 
sheaves with the corresponding graded oExt-groups. Similar to Defjr (resp. Def^- j(Jy ) we may define 
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local deformation functors Defp (resp. ~Def FH o( a -j) on I of flat graded deformations Fg of F (resp. 

B® k S F s of B F). There is a natural forgetful map po ■ Defp^o^) — > Defp whose 

tangent map fits into (*) and corresponds to p 1 in (fT2l . Since oExt 1 (B,F) = in (*), it follows 
that 

Po ■ Def F) #o( CT ) Def F 

«s smooth by the first (i.e. the cohomological) proof of Theorem^ (i) above. 

(b) Suppose Y is ACM and oHorn^F, M) = 0. Then we claim that Defy ~ Def^. Indeed by ([5]) 

-> Ext^(F,F) -> Ext^ y (F,F) -» Ext^(F,F) -> Ext|(F,F) -> Ext^(F,F) 

is e:mc£ ane? oExt^(F, F) = oHoni£(F, M) fry (J3j) . Hence we get the claim by the same cohomological 
argument as used in Theorem^ (i) above. In the same way (or directly) we can prove that DefjF ;(T ~ 
T)eff fjor a y It follows that the morphism p : Defy, CT - ► Defy of Theorem^ is smooth. 

3 Reflexive sheaves on P 3 of small diameter 

As an application we concentrate on My(ci, 02,03) with Y = P 3 . Recalling the notion F = H®{T) := 
®H°(T(v)), M = Hl{T) and E = tf*(F), we have 

Theorem 9. Let T be a reflexive sheaf of rank 2 on P 3 , and suppose either 

(i) v Hom.ji(F, M) =0 for v = and v = — 4 , or 

(ii) v ilom R (M, E) = for v = and v = —4 , or 
(Hi) Rom R (F,M) = , Hom R (M,E) = and that 

M is unobstructed as a graded module (e.g. oExb R (M, M) = 0). 

Then T is unobstructed. Moreover ifoF>xt R (M, M) = for i > 2 and T is stable, then M P 3 (c\ , 02,03) 
is smooth at (J 7 ) and its dimension at (T) is 

dim (JF ) Mps(d, pa, c 3 ) = ed(F) + _ 4 hom /? (F, M) + _ 4 hom i? (M, £7) + Q hom fl (F, E) . 

Furthermore _ 4 hom jR (M, E) = ext^(F,M) and _ 4 hom fl (M,F) + hom R (F,E) = _ 4 ext}j(F, F). 

Note that Theorem [9] applies to prove unobstructedness if M = (this case is known by |33J). 
The natural application of Theorem [9] is to sheaves whose graded modules M are concentrated in 
a few degrees, e.g. diamM < 2. For such modules we can prove more, namely that the sufficient 
conditions of unobstructedness of Theorem [9] are quite close to being necessary conditions. Indeed 
if the diameter of M is one, they are necessary! Moreover in such cases a minimal resolution of J 7 
is often sufficient for computing the Horn-groups in the theorem (see also Lemma [12] below). 

To find necessary conditions we consider the cup product or more precisely its "images" in 
Rom R (F,E), _ 4 Hom jR (F,M) v and _ 4 Hom fl (M, F) v via some natural maps, cf. [47], [TO], [23] 
and [26J, §2. Here we only include the cup product factorization given by (a) and hence (b)(i) below, 
for which there is a proof in [23], Prop. 3.6 of the corresponding result for curves using Walter's 
factorization of a in (J6j) . We remark that this result for curves, to our knowledge now, was first 
proved by Ffoystad (an easy consequence of Prop. 2.13 of [10J). For similarly generalizing the cases 
(ii) and (hi) of (b) we refer to [23], Prop. 3.8. Note that the necessary conditions in (b) apply to 
many other sheaves than to those of diameter one (i.e. those with M' = 0), e.g. they apply to 
Buchsbaum sheaves and to sheaves obtained by liaison addition of curves. 
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Proposition 10. Let T be a reflexive sheaf of rank 2 on P 3 and suppose oExt|j(M, M) = 0. 

(a) If the natural morphism 

Homfl(F,M) x ftom R (M,E) — » Hom fl (F^) 
(given by the composition) is non-zero, then T is obstructed. 

(b) Suppose M admits a decomposition M = M' © Mm as R-modules where the diameter of Mm is 
one and supported in degree t. Then T is obstructed provided 

(i) Rom R (F,M [t] )^0 and Hom fl (M w , £) + , or 

(ii) _4Homfl(F,M [t] )^0 and Homfl(M [t] , £) ^ , or 
(m) oHo m/? (F,M w ) / and _ 4 Hom ii (M [t] , E) + . 

Proof (of Theorem ana 1 Proposition [W\) . To prove the results we may replace T by for j >> 
because, for both results, the assumptions as well as the conclusions hold for T iff they hold for 
In particular we may assume H l (T(v)) = for v < and hence Ext 2 (^, O p3 ) v ~ H l {F{-A)) = 0. It 
follows that the maps p and q of Theorem [3] are smooth. From the Hartshorne-Serre correspondence 
we get an exact sequence 

-> R -► F -» 7x(ci) -» 
which implies M = H+ijF) ~ iT^(Xx(ci)), We also get the exact sequence 

Q —> E = Hl{F) - Hl(l x { Cl )) -» ^ 3 (O p3 ). 

Using these sequences and H l (Tx{c\ + u )) = for u < we get 

„Hom fl (F, M) ~ w Homji(/x, tffe)) and „Hom fl (M, £) ~ 1 ,Hom i? (^ 1 (T x ), # 2 (Jx)) (17) 

for -4 < « < because v Rom R (R, M) = and „Hom#(M, fl*(Ops)) ~ „Ext* (M, R) ~ M^_ 4 = 
by © and Now recall that we in [23] proved results similar to Theorem [9] and Proposition ITOl 
for the unobstructedness (resp. obstructedness) of X with the difference that the Horn-groups, 
„Hom/j(/7*(jr), Tf* +1 (JF)) for T were exchanged by the corresponding groups, v Kom. R (Hl(lx), Hl +l (lx)) 
forXx. Therefore (fl~7l) and Theorem [3] show that T is unobstructed in Theorem [9] (resp. obstructed 
in Proposition [TOj) because X is correspondingly unobstructed (resp. obstructed) by the results of 
[23], Thm. 2.6 (resp. Prop. 3.6 and Thm. 3.2) and Remark dH below. 

To prove the dimension formula we suppose oExt R (M,M) = for 2 < i < 4. With this 
assumption the map a in J6]) is zero by Walter's observation. Note that there is a corresponding 
connecting map a(Ni,N2) '■ oExt^iVi, N2) — > oExt|,(A r i, AT 2 ) appearing in (|5j). Indeed a = 
a(Ix,Ix)- We c/aim that a(F,F) = 0. To see it we use the functoriality of the sequence ([5|) and 
a = 0. Since the natural map oExt R (I x (ci), F) — > oExt|j(/x(ci), -Tx(ci)) is an isomorphism by 

Ext2j(/ x ( Cl ),F) v ~ _ 4 Ext 2 n ( J P,/ x (c 1 )) ~ _ 4 Ho mi? (F,M), 

oExt|(/x(ci),/x(ci)) v ~ ^Ext^/x,/^) =i -4Rom R (Ix,Hl(I x )) 

and (fT7|l . we get a(I x (ci), F) = 0. In the same way the natural map oExt 2 n (/x(ci), F) — » oExt 2 n (F, F) 
is an isomorphism by JIJ) (i.e. both groups are naturally dual to _ 4 Hom^(i ? , M) by Q) and we get 
the claim from a(Ix(ci), F) = 0. Now using the fact that the projective dimension of F is 2, the 
proven claim and (J5j) , we get an exact sequence 

- Ext|(F, F) -> Ext^ (.F, F) -> oExt^F, F) -> 0. (18) 
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As above Ext|(F,F) v ~ _ 4 Hom i j(F,M) and similarly Ext^(F,F) v ~ _ 4 Ext)j(F, F) by ®. We 
get extji, (.F, F) = _ 4 honiR(F, M) + _ 4 ext)j(F, F). Using ((3|) we get an exact sequence 

-» oExt^(F, M) -» oEx4(F, F) -» Hom R (F, F) -> Ext|(F, M) (19) 

and hence _ 4 ext}j(F, F) = ext^(F, M) + hom i? (F, F) because 

Ext|(F,M)~ _ 4 Ex4(M,F) v ~ _ 4 Ho mi? (M,M) v ~ Ext^(M, M) ~ Ext|j(M, M) = 0. (20) 

By the arguments of ([20]) we also get _ 4 Ext^(M, M) v ~ Ext|(M,M) = and 

ext)j(F,M) = _ 4 ext 3 n (M,F) = _ 4 h om/? (M,F) 

and putting things together we are done. □ 

Remark 11. Thm. 2. 6 (Hi) of f23l/ actually proves a slightly weaker statement than needed to prove 
Theorem\§(iii) . However, putting different results of e.g. [23] together we get what we want. Indeed 
we claim that a curve IcP 3 is unobstructed provided 

Q Rom R (I x ,Hl(l x )) = , Kom R (Hl(l x ),H*(l x )) = , (21) 

and Hl{T x ) is unobstructed as a graded module (e.g. Ext 2 R (Hl(2 x ), Hl(l x )) = 0) . This 
is mainly a consequence of results proven in [27] by Martin-Deschamps and Perrin. Indeed their 
smoothness theorem for the morphism from the Hilbert scheme of constant cohomology, H(d,g) cc , 
onto the scheme of "Rao modules" (Thm. 1.5, p. 135) combined with their tangent space descriptions 
(pp. 155-156), or more precisely combined with Prop. 2.10 of f23^ which states that the vanishing of 
the two Horn-groups in (|21l) leads to an isomorphism H(d,g) cc ~ H(d,g) at (X), we conclude easily. 

We can compute the number ohom^(F, F) in terms of the graded Betti numbers (5j : i of F; 

-> Ri-if'*' 1 ~+ R{~if 2 ' 1 Ri-if 1 ' 1 -> F (22) 

i i i 

(sheafifying, we get the "resolution" of F in the introduction), by using the following result. 
Lemma 12. Let F be a reflexive sheaf of rank 2 on P 3 , and suppose _ 4 Hom^(F, F) = 0. Then 

hom R (F,E) = ]T(/3 M - (3 2A + ■ (h 2 (F(i)) - h 3 (T(i))) . 

i 

Proof. Recall F := F^(F) ~ H^(F). If we apply „Hoiiib(- , F) to the minimal resolution (l22j) we 
get a complex 

-> oHom^FF^F)) -4 0H 2 (f(i))^ -$F 2 (f(i)) ft - - $ff 2 (f(i)) fe " - . (23) 

i i i 

Since the alternating sum of the dimension of the terms in a complex equals the alternating sum 
of the dimension of its homology groups, it suffices to show Ext^(F,F) = 0, Ext|(F,F) ~ 
oHoniR,(F,F 3 (F)) and that 

O ho m/? (F, F 3 (F)) = ^ (/?!,* - 02,i + M ■ h 3 (F(i)). (24) 
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Using © and that Ext^(F, F) ~ _ 4 Hom i? (F, F) v = by assumption, we get Q Ext l R (F, H^(F)) = 
and an exact sequence 

-» Hom R (F, <(F)) -> Ext|(F, H^(F)) -> Ext 5 m (F, F) -> Ext^(F, < (F)) - 0. 

Since we have oExt^(F, F) = the proof is complete provided we can show ([241) , To show it, it is 
sufficient to see that ([23)), with F 2 replaced by H 3 , is exact. Since we have oExt^(F, F) = for 
i = 5, 6 by duality, we get oExt^(F, H^(F)) = for i = 1, 2 by J3|) and we are done. □ 

Remark 13. For later use we remark that if we apply ohoniR(— ,M), M = F*(F) to ([22]) we get 

2 

]T(-ir oexf(F, M) = ~ + ■ h\T(i)) , (25) 

i=0 i 

cf. ([23]) . Suppose T is reflexive and _ 4 Hom#(F, F) = 0. Using j3]) as m (|19p and the proof above 
we get Ei=2(~ 1 ) i oext' m (F, F) = E^-l)* oext*(F,M) - hom i? (F, F). Fence we ftave 

3 

£(-1)' ext J m (F, F) = £(/3 M - fly + • (^(^(O) " ^VW) + ^ (^(0))- 

i=2 t 

It is easy to substitute the non- vanishing of the Horn-groups of Theorem [9] by the non-triviality 
of certain graded Betti numbers in the minimal resolution of F. Indeed we have 

Theorem 14. Let IF be a reflexive sheaf of rank 2 on P 3 and suppose M ^ is of diameter 1 and 
concentrated in degree c. Then J- is obstructed if and only if 

Pi,c ■ /?2,c+4 7^0 or A,c+4 • /?2, c +4 or f3^ c ■ (5 2 , c / . 

Moreover if J- is an unobstructed stable sheaf and M is r -dimensional, then the dimension of the 
moduli scheme Mps(ci, c 2 , C3) at (F) is 

dimpr) M p3 (ci, c 2 , c 3 ) = ed(F) + hom jR (F, F) + r(/3i )C+4 + /3 2jC ). 

Before proving Theorem [14], we remark that we have the following result 

Proposition 15. Let J 7 be a reflexive sheaf of rank 2 on P 3 and suppose M 7^ is of diameter 1. 
Then LF is obstructed iff (at least) one of the following conditions hold 

(a) Hom K (F,M) ^ and Hom fi (M,F) ^ , 

(6) _ 4 Hom iJ (F,M) / and Rom R (M,E) ^ , 

(c) Hom J? (F,M) ^ and _ 4 Hom il (M,F) ^ . 

Indeed if F is unobstructed, then it is a simple reformulation of Theorem [9] to see that we have 
either (a) or (b) or (c). The converse follows immediately from Proposition [10] by letting M' = 0. 

Proof (of Theorem [Lfy. By applying „Hom^(-,Af) to the minimal resolution ([221) we get 

hom R (F,M) = r(3 1)C and _ 4 h omi? (F,M) = r(3 l:C+4 . (26) 

because m • M = and = F(-c - 4) r . Moreover _„_ 4 Ext}j(F, M) v ~ „Hom fl (M, F). 

Interpreting _„_ 4 Ext)j(F, M) similarly via the minimal resolution ([22]) of F, we get 

hom fl (M, F) = r/3 2jC+4 and _ 4 ho m/? (M, F) = r/3 2jC . (27) 

Since r / 0, we get the unobstructedness criterion and the dimension formula of Theorem [T4l from 
Proposition [15] and Theorem [9] □ 
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Theorem 16. Every irreducible component o/M P 3(ci, C2, C3) whose generic sheaf J 7 satisfies diamM < 
1 is reduced (i.e. generically smooth). 

Proof. By replacing T by T{j) for j » (cf. first part of the proof of Theorem [9]) , we can use 
the Hartshorne-Serre correspondence to get a corresponding curve X such that all assumptions of 
Theorem [5] are satisfied. Hence X is generic and diam.ff*(Zx) < 1. Since it is proved in [23], Cor. 
4.3 that a generic curve X of diameter at most one is unobstructed, it follows by Theorem [5] that F 
is unobstructed, i.e. the corresponding component Mps(ci, C2, C3) is generically smooth and we are 
done. □ 

Example 17. Using some results of Chang on £1 -resolutions of Buchsbaum curves (JM/ or [J 7 ^ , Thm. 
4-1), one shows that there exists a smooth connected curve X of diameter 1 satisfying h°(2x(e)) = 1, 
h l (Zx(e)) = r, h l {Ox{e)) = b, h l (Ox{v)) = for v > e and with e = 1 + b + 2r and Q-resolution 

-> C P (-2) 3r - 1 © P (-4) fe -> Op © O r © Op(-3) fe - 1 -» T x (e) -» (28) 

for any pair (r,b) of positive integers (cf. \23j . Ex. 3.12). Moreover the degree and genus of X is 
d = ( e ^ 4 ) — 3r — 7 and g = (e + l)d — ( e ^ 4 ) + 5. Recalling that £1 corresponds to the first syzygy in 
the Koszul resolution of the regular sequence {Xq, X\, X2, we get an exact sequence 

-> P (-4) -► Op(-3) 4 -» Op(-2) 6 -> ft -» 

Hence we can use the mapping cone construction to show that there is a resolution 

0^O P (-4) r ^Op(-4) fe ffiOp(-3) 4r ffiO P (-2) 3r - 1 ^Op(-2) 6r ffiOpffiO P (-3) 6 - 1 ^ J x (e) ^0 

(29) 

where we possibly may skip the factor Op(— 2) 3r 1 (and reduce 0p(— 2) 6r to Op(— 2) 3r+1 y ) to gei a 
minimal resolution. Instead of looking into this problem, we will illustrate \2S§ . Thm. 4-1, which 
makes a deformation theoretic improvement to a theorem of Rao (\39§ Thm. 2.5). Indeed since 
the composition of the leftmost non-trivial map in ([291) with the projection onto 0p(— 2) 3r ~ 1 is zero 
(by Rao's theorem), there is by \2S§ . Thm. 4-1 a deformation with constant cohomology and Rao 
module to a curve X' which makes Op(— 2) 3r_1 redundant (no matter whether the original factor 
was redundant or not)! So we certainly may skip the factor C P (-2) 3r - 1 (and reduce C P (-2) 6r to 
Op(— 2) 3r+1 y ) ; at least after a deformation. 

Now, by the Hartshorne-Serre correspondence there is a reflexive sheaf J 7 given by 

0^O P ^T^l X '(e + A)^0. (30) 

which combined with the Horseshoe lemma \4 9\j leads to the following minimal resolution of T , 

-» 01 -»■ op e Op(i) 4r Op(2) 3r+1 e e> P (4) © o P (i) b ~ 1 © o P t -»■ o . (31) 

Note that /i 1 (^ r (— 4)) = h}(Ix{e)) = r, i.e. the number c of Theorem^T^is c = —4. From (l3"T1) we 



see that fyo = b ^ and (3% _4 = 1. By Theorem 14 , T is obstructed 



Computing Chern classes Cj of T we get c\ = e + 4, C2 = d = ( g 1 ) — 3r — 7 and C3 = (g 1 ) — 
(2 1 ) (3r + 7) + 6r + 22. The simplest case is (r,b) = (1,1), which yields a reflexive sheaf J 7 whose 
normalized sheaf 4) is semistable and with Chern classes (ci, c£>, c' 3 ) = (0, 2, 4) (the corresponding 
curve X has d = 18, g = 39 and is Sernesi 's example of an obstructed curve, \41^ or J^, see also \36$ 
which thoroughly studies M P 3(0, 2, 4) and [35] which uses Sernesi's example to show the existence of 
a stable rank 3 obstructed vector bundle,). For (r,b) 7^ (1,1), then e > 4 and we see easily that the 
sheaves constructed above are stable. If (r,b) = (2,1), then the normalized sheaf has Chern classes 
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(c'^c^Cg) = (0,7,24) while (r,b) = (1,2) yields stable sheaves with (c^c^Cg) = (—1,6,22). One 
may show that all curves corresponding to the sheaves of the case (r,l) satisfy h (Mx) = 1- The 
ideal of the local ring ofH(d,g) at (X) is generated by a single element, which is irreducible for 
r > 1. Indeed the case (r = 1) corresponds to a sheaf which sits in the intersection of two irreducible 
components of 'Mp3 (01,02,03), while for r > 1, the irreducibility of can be used to see that ("F) belongs 
to a unique irreducible component o/Mp3 (01,02,03). 

In the examples [6] and [7] the diameter of M of the obstructed generic sheaves is 3. Combining 
the results of this paper with the large number of non-reduced components one may find in |20| 
we can easily produce similar examples for every diamM > 3. Indeed, as is well known, a smooth 
cubic surface XcP 3 satisfies Pic(X) ~ Z® . It follows from the main theorem of [20] (or of [38 j ) 
that the general curve which corresponds to (3a, a 5 , 2) G Z® 7 is the generic curve of a non-reduced 
component of H(d, g) for every a > 4 (Mumford's example corresponds to a = 4). The diameter 
is 2a — 5. In the same way the general curve which corresponds to (3a + 1, a , 2) € Z® 7 is the 
generic curve of a non-reduced component of H(d, g) with diamM = 2a — 4 for every a > 4. Using 
Theorem [5] for q = 2 we get non-reduced components of Mp3(ci, 02, 03) for every diamM(.F) > 3, 
T the generic sheaf. Thanks to Theorem [16] there is only one case left and we expect: 

Conjecture 18. Every irreducible component of Mp3(ci, 02, 03) whose generic sheaf J 7 satisfies 
diamM = 2 is reduced (i.e. generically smooth). 

There are some evidence to the conjecture, namely that every Buchsbaum curve of diameter 
at most 2 admits a generization in H(d, g) which is unobstructed ([23], Cor. 4.4), i.e. belongs to 
a generically smooth irreducible component. By the arguments in the proof of Theorem [16] every 
Buchsbaum sheaf of diameter at most 2 must belong to a generically smooth irreducible component 
of some M P 3 (ci , 02 , 03 ) . 

4 A lower bound of dimMp3(ci, C2, C3). 

In this section we want to give a lower bound of the dimension of any irreducible component of 
M P 3(ci, 02, 03) in terms of the graded Betti numbers of a minimal resolution of the graded .R-module 
F = H®^), see (|22l) . The lower bound is straightforward to compute provided we know the 
dimension of the cohomology groups H l ("F(v)) for any i and v. It is well known that ed(.F) = 
8c 2 - 2c\ - 3 is a lower bound, but there are many examples of so-called oversized irreducible 
components whose dimension is strictly greater that ed(^). Our lower bound is usually much closer 
to the actual dimension of the oversized components provided Hl{F) is "small". If a component 
of Mp3(ci, C2, C3) is generically smooth, we also include a formula for dimension of the component 
which is a sum of the lower bound and a correction number which we make explicit. 

Definition 19. If J 7 is a reflexive sheaf on IP 3 , we let 

i 

Remark 20. If T is reflexive on P 3 and _4Hom^(F, F) = 0, then 

hom R (F,E) =6 2 -5 3 
by LemmaUM This makes the dimension formulas of Theorems of\^and\Tdimore explicit. 
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Proposition 21. Let J 7 be a reflexive sheaf on IP 3 satisfying -iHom R (F, F) = 0. Then 

ext R {F, F) - ext|(F, F) = hom R (F, F) — 8° = ed(^) + <5 2 - 5 1 - 5 3 . 

Proof. To see the equality to the left, we apply oHomR(— ,F) to the resolution (|22l) . We get 

hom R (F, F) - ext^(F, F) + Q ext 2 R (F, F) = 6° . 

Moreover the right hand equality follows from (TJ|) and {5]). Indeed we have already considered the 
consequences of in Lemma [12] and Remark [T3l We have 

ext 2 m (F, F) - extl(F, F) = 5 1 - 5 2 + S 3 

by Remark [T3l Combining with the exact sequence ((6)) which implies 

ed(F) = oext^F, F) - ext 2 R (F, F) + ext^(F, F) - ext 3 n (F, F) , 

we get the last equality. □ 

Theorem 22. Let J 7 be a stable reflexive sheaf on P 3 . Then the dimension o/Mpa(ci, C2, C3) a£ (J 7 ) 
safe/ies 

dim (JF) M P 3 (ci, c 2 ,c 3 ) > 1 - 5° = ed(F) + 5 2 - 5 1 - 5 3 . 

Moreover if T is a generic sheaf of a generically smooth component V of Mp3(ci, C2, C3) and M = 
Hlif), then 

dimy = ed(-F) + 5 2 - 5 1 - 5 3 + _ 4 hom R (F, M) 
where -4Rom R (F, M) is the kernel of the map 

0^(^-4))^ __0 H l(jr (j _ 4 ))A,i 
i j 

induced by the corresponding map in (|22p . 

Remark 23. Lei J 7 be a stable reflexive sheaf on P 3 . 

(i) If M = 0, then 5 1 = and we can use 27ieorem[5| and i?emarft [221 to see i/ia£ i/ie /ower bound of 
Theorem\2Eis equal to dim^ M P 3(ci, c 2 , c 3 ). This coincides with [33l/ . 

(ii) // diamM = 1 and T is a generic unobstructed sheaf, then the lower bound coincides with 
ed(F) + ohom^(F, E) + r/? 2>c of Theorem\lJ^ because rf5\ jC = for a generic sheaf by [23], Cor. 4-4 



and the proof of Theorem\lb\ Moreover in this case the correction number _4hom^j(i ? , M) is equal 
to r/?i jC+ 4. Hence we get the dimension formula of Theorem\T^from Theorem\2^in this case. 
(iii). The lower bound of Theorem{£M is clearly better that the bound ed(J-) provided 5 2 > 5 1 + 5 3 . 



Proof. By a general theorem of Laudal [24] on the dimension of the hull of any local deformation 
functor, we get that oext R (F, F) — oext 2 R (F, F) < dim Op where Of is the hull of the deformation 
functor of the graded module F (see Remark [8]). To get the inequality of the theorem it suffices, by 
Proposition EH to prove dim Op < dim^ Mps(ci, c 2 , C3). Since we will use Theorem [5] we replace F 
by F(v) for v » to have the assumptions of Theorem [5] satisfied. It is known the Hilbert scheme 
H(d, g) contains a subscheme H := H(d, g)^ which is the representing object of the subfunctor of 
flat families of curves with fixed postulation 7. For the local deformation functors at a curve (X) 
the latter corresponds precisely to the graded deformations of the homogeneous coordinate ring of 
X ([27] and recall >y(v) = h°(l x (v)), v £ Z, see also [23J). Hence we get 

dimO Hj{x) = dim (x) H(d,g) 7 < dim (x) H(d, g). (32) 
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By Theorem H] dim^r) M P 3(ci, c%, C3) + h°(T) = dimp^ H(d, 5) + h°(uj x (—ci + 4)). We claim that 

dimO F + h°(F) = dimO H:(x) + h\ui x {- Cl + 4)). (33) 

This is mostly explained in Remark [8] Indeed the natural forgetful map po : Dei F H o^ — > Defir 
is smooth and has the same fiber as the forgetful map p : Def jr j(J — > Defjr in Theorem [5] by Re- 
mark [8] In the same way the corresponding graded variation of q : Def^ i(J — > HUb^/pa is smooth 
by oExt 2 (/x(ci), R) — Ext 2 (Xx(ci), Op3) = and its fiber coincides with that of q, due to the iso- 
morphism oExt 1 (/x(ci), R) — Ext 1 (Tx(ci), P 3) (cf. J3]) and (|5j)) and the arguments of RemarkO 
This proves the claim and the inequality of the theorem. 

It remains to prove at _4hom^j(F, M) is the correction number since the reformulation as a 
kernel is trivial. Let X be the generic curve of a component of H(d, g) which corresponds to V, 
Let 7 be the postulation of X. Since there is a smooth open subscheme U 3 (X) of H(d, g) of 
curves with postulation 7, we get H(d, g) 7 D XJ = H(d, g) D U. Hence H(d, g) 1 is smooth at (X) 
and we have equality in ([32]). By Theorem [5] and ([33]) . dimOp = dimpr) M P 3(ci, C2, C3) and Of is 
smooth. Hence dimOp = oex.t R (F,F) and oext^(F, F) is the correction number. Since we have 
Ext 2 R (F, F) v ~ _ 4 Hom i? (F, M) by ©and ((1), the proof is complete. □ 







In |23j we proved a result (Lem. 2.2) similar to Proposition [21] for any curve X with minimal 
resolution, 

R(-if 9 * - R(~if 2 - - R(-if^ - Ix - , (34) 

i i i 

namely that 

ext R {I x , I x ) - ext 2 R (I x ,I x ) = l-5 I = 4d + 5j-5} (35) 

where Sj = ~ 02i + P3 ») ' h^(T x (i)) and d = deg(X). Note that the difference of the ext- 

numbers in ([35]) is a lower bound for dimOn^) ([23], proof of Thm. 2.6 (i)). As a by-product 
of ([32]) and the proof above we get 



Theorem 24. Let X be a curve in P 3 . Then the dimension of dimpn H(d, ai (X) satisfies 

dim (x) H(d, <?) > 1 - 5? = 4d + <5 2 - <5). 

Moreover if X is a generic curve of a generically smooth component V ofH(d,g) and M = Hl(l x )> 
then 

dim V = Ad + 5] - 5} + _ 4 hom i? (ix, M) 

where _4Hom/j(/x 5 M) is the kernel of the map (Bi&ilxii-*)/*.* -» ©^(Xx^))^ induced 
(33). 

Remark 25. Lei X &e any curve in P 3 . 

(i) If M = 0, then 5} = and we can use Theorem 2.6 of }23\/ to see that the lower bound of 
Theorem\2]\is equal to dimpn H(d, g). This coincides with 



(ii) 7/diamM = 1, dimM = r and X is a generic unobstructed curve, then the lower bound is equal 
to Ad + Sj + r/3'2 c because r(3[ c = for a generic curve by J23^ . Cor. 4-4- Moreover in this case the 
"correction" number _4hom. R (I x , M) is equal to r[5' lc+A . Hence we get 

dimV = 4d + <5? + r((3' 2c + P' lc+4 ). 
This coincides with the dimension formula of \2c§ . Thm. 3.4- 
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